NLA explanations can be shortened without harming reconstruction

Natural language autoencoders are a really cool mostly-unsupervised method for producing free-form text explanations of LLM activations. You should read that paper (or the blog post) about them before reading this.I trained[1] several Qwen3-8B NLAs with different length penalties: during RL, I subtr…

View Post on Scour ↗

More from lesswrong.com on Scour.

Covers 2 stories including Natural Language Autoencoders Produce Unsupervised Explanations of LLM Activations